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ABSTRACT 

In this paper, we introduce an optimality condition that, roughly formulated, says that an approximate gradient 
projection tends to zero. For this reason, we call it approximate gradient projection (AGP) property. We prove that the 
AGP property is satisfied by local minimizers of constrained optimization problems independently of constrained 
qualifications and using only first - order differentiability. Unlike the KKT conditions, the new condition is satisfied by 
local minimizers of nonlinear programming problems, independently of constraint qualifications. 

KEYWORDS: Optimality Conditions, Karush - Kuhn - Tucker Conditions, Minimization Algorithms, Constrained 
Optimization 

INTRODUCTION 

Any optimization problem essentially consists of an objective function. Depending upon the nature of objective 
function (O.F.), there is a need to either maximize or minimize it. If certain constraints are imposed, then it is referred to as 
constrained optimization problem. In the absence of any constraint, it is an unconstrained problem. Linear programming 
(LP) methods are useful for the situation when O.F. as well as constraints are the linear functions. Such problems can be 
solved using the simplex algorithm. Nonlinear programming (NLP) is referred to the followings:(a) Nonlinear O.F. and 
linear constraints^) Nonlinear O.F. and nonlinear constraints(c) Unconstrained nonlinear O.F. Since the 1960s, much 
effort has gone into the development and application of numerical algorithms for solving problems in the two areas of 
optimization and systems of equations. As a result, many different ideas have been proposed for dealing efficiently with 
(for example) severe nonlinearities and/or very large numbers of variables. Libraries of powerful software now embody the 
most successful of these ideas, and one objective of this volume is to assist potential users in choosing appropriate software 
for the problems they need to solve. More generally, however, these collected review articles are intended to provide both 
researchers and practitioners with snapshots of the v state-of-the-art' with regard to algorithms for particular classes of 
problem. These snapshots are meant to have the virtues of immediacy through the inclusion of very recent ideas, but they 
also have sufficient depth of field to show how ideas have developed and how today research questions have grown out of 
previous solution attempts. 

A Variety of applications in engineering, decision science, and operations research have been formulated as 
constrained nonlinear programming problems (NLPs). Such applications include neural -network learning, digital signal 
and image processing, structural optimization, engineering design, computer-aided-design (CAD) for VLSI, database 
design and processing, nuclear power plant design and operation, mechanical design, and chemical process control [1][2] . 
Due to the availability of a lot of unconstrained optimization algorithms, many real applications that are inherently 
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nonlinear and constrained have been solved in various unconstrained forms. Optimal or good solutions to these 
applications have significant impacts on system performance, such as low-cost implementation and maintenance, fast 
execution, and robust operation. Every constrained NLP has three basic components: a set of unknowns or variables to be 
determined, an objective function to be minimized or maximized, and a set of constraints to be satisfied. Solving such a 
problem amounts to finding values of variables that optimize (minimize or maximize) the objective function while 
satisfying all the constraints. 

When the constraint qualification is the one introduced by Mangasarian and Fromovitz [1], we say that the 
Fritz - John optimality condition is satisfied. Perhaps separation techniques are the most powerful tools for proving 
optimality conditions [2-6]. Therefore, according to that model global theorem, the algorithmic sequence might converge 
to points where the constrained qualification is not satisfied. 

Therefore, both practical experience and common sense indicates that the set of feasible limit points of good 
algorithms for constrained optimization, although being larger than the reputation of the KKT conditions lies not only in 
being necessary optimality conditions under constraint qualifications, but also in the fact that they are sufficient optimality 
conditions if the nonlinear program is convex. Essentially, we prove that this is also true for the AGP property. 

THE NECESSARY CONDITION 

Consider the NLP 

minf(x), s.t.xE Q, (1) 
where 

n = {x E DHjM < QMzj = 0}, (2) 
/: \EL n D£,ft: IR" -> [R^ L ,^: K n R p , and all the functions have continuous first partial derivatives. 
Let y E [-sb, 0]. For all x G H 71 , we define Cl (x, y) as the set of points z E H^that satisfy 

5iM + - *5 < 0, if y < jffjtfx) < 0, (3) 

0i(*}(z-r)<O, if^:(jO>0, (4) 

kXx){z-x) = 0. (5) 

The set (1 fey), a closed and convex polyhedron, can be interpreted as a linear approximation of the set of points 
ZEIR" that satisfy 

fcGO = h{x}, 

3i(z}<Q, if Or 00 E (y, D). 

Observe that 

n(>.. Cu = [z E [R n |h r O)(z - x) = 0,^-00 O -X) < 0,if g^x} > 0,t = 1, ,p£ 

For all x E IR", we define 
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dix t y) = P m .xA x ~ v f^ ) " ( 6 ) 

Where P e {y) denotes the orthogonal projection of y onto C for all y E 7*'*,C c closed, convex. The vector 
d(x.. y) will be called the approximate gradient projection. 

We will denote II II = II - II = and 

B = {z E IR n | II z-x ||<pj, 

for all x E IR", p > 0. As usual, for all v E [R n , v = (y v , v a y we denote 

Theorem 2.1 

Assume that is a local minimizer of (l)-(2), and let v E [-==.. 0], E, t? > be given. Then, there exists x E H 71 

such that 

■ j — B< ff and II if^y) 1< e. 

Proof 

Let p E (0, <Ti be such that x" is a global minimizer of on fl nB (jt*, p). For all x E Ift 11 , define 

= /M +(E/2p)IU- .t " II 
Clearly, is the unique global solution of 

min $(x) . s.t. xE ft nB (V, p). (7) 

For all x E IR", fi > D, define 

= pCO + II" +ll K'+ II"]. 

The external penalty theory (see for instance Ref. 12) guarantees that, for n sufficiently large, there exists a 
solution of 

min , s.t. xeB (x \ p) B (8) 

that is as close as desired to the global minimizer of tp(_xj on U nB (x m ..p"\. So, for u large enough, there exists a 
solution x a of (8) in the interior of B fx*, p"\. Therefore, 

Thus, writing for simplicity £ = x af we obtain 
= W^M 

= ?pto + 4*'W r *W + Ej^ft W^ft 

So, 

V/M + n[fc'(ar} r JiW + E Jw> .ftMVft(*3l + (e/rtt* - **) = o. (9) 
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Since * = lies in the interior of the ball, we have that 
II*-*- II <p< 6. 
So, by (9), 

|V/M +4 k Wh(& + lg K ^9iW^9iW] I ± 
So, 

|[* - - +Mh r M T hM I < 

Taking projections onto ftfcr..y), this implies that 

I^Wt* " TC 1 ) ~ p *ixJ* + J^'M^M + JiM^i W]) I ^ (10) 

It remains to prove that 

To see that this is true, consider the convex quadratic subproblem 
min^ \y-(x + v\k r (Xfk(x) +E^^(^%iW])|f , 
s.t. vEQ(j[-,7j, 

and observe that y = x satisfies the sufficient KKT optimality conditions with the multipliers 
A = -fih(x), 

v.: = ligii*), for^iW ^ °> 
Vj = 0, else. 
So, by (10), 

as we wanted to prove. 
Corollary 2.1 

If jr"is a local minimizer of (1) - (2) and if y G [-=c, 0], there exists a sequence c \k n such that lim y.^ = r*and 
lim d[%*py) = 0. 

Property 2.1 

Assume that £ CO < 0,fe<V) = 0,* K -** u , and that, for some y G 0], dO K ,y) -* 0. Then, d(* ft J y r ) -» for all 

/ < 0. 
Proof 

Consider the problems 

min||i*-V/Cx*)-y|| a , (11) 
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s.t. gl(x k -)(y-x k )<0, if0i(**)>Q, (12) 

ftV)fr-**) < 0, if > > 7, (13) 

h'(x*)(y - x*~-\ = (14) 

and 

min H** - V/V) - y|| 2 , (15) 

s.t. $l(x k )(y -x^i < 0, if > 0, (16) 

ft f (x*)CF-**) <0, if 0>^0^'>/, (17) 

h r Ot K )(y-^ K j = (18) 

Let 3 rh be the solution of (11)-(14). By the hypothesis, we know that |y K — ar K | — * 0. Therefore, y k - x\ Let us 
know that, for k large enough, y _t satisfies the constraints (16)— (18). Let us prove that the same is true for (17). We 
consider two cases: J^OO = and .g=0O < 0. 

If tfjfrO = 0, then for k large enough, ^iO'^J >Y. Therefore, if in addition < 0, the constraint (17) is 

satisfied. 

If .grOO < 0, then since |y * - x* | -h 0, we have that, for k large enough, 

+ gl(x k )(y k - x k j < 0. (19) 
Therefore, the constraints (17) are also satisfied at y \ 

But. 1 .'" 1 is the KKT point of the problem (11)— (14). By the analysis performed above, an active constraint of type 
(17) can correspond only to ^00 = Oand ^iO^J < 0. In this case, £[0^3 > Y fork large enough; thus the constraint is 
present in the set (13). This completes the proof. 

Mangasarian - Fromovitz (MF) Constraint Qualification 

If A E lffi m and pi E Ift p , fi > are such that 

h r (jt*) T i + §\x"y u = and ir^OO = 0,then i = and ,u = 0. 
Theorem 2.2 

Assume that r*is a feasible point. Let y E [-cc,0]. Suppose that there exists a sequence x* 1 x* such that 
y) 0. Then, ac* is a Fritz-John point of (l)-(2). 

Proof 

Define 

So, y * solves 

min [1/2}§F-x*|| 3 + vf{x k f(y-x k -), 
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s.t. yE^^j). 

Therefore, there exist l k E B™ fi* E ffi p , fi* > such that 

?/"<>• K ;i + (y K - * ft 3 + ft'Ca;*)^ + £ r (Jt K ) T ^ K = 0, (20a) 

^0*3 + -gK* K )Cy K -s K )] = o, if r < Q, (20b) 

toitc K j(y K - * K )] = o, if ^x*) > o, (20c) 

*if = 0, else. (20d) 

Moreover, if g^ix*) < 0. we have that 0iO^} < for k large enough; and since \p — x^|] -* 0, we have also that 

in that case. Therefore, we can assume that 

Pi = whenever g^x*) < (21) 

To prove the Fritz-John condition is equivalent to proving that the MF condition implies the KKT condition. So, 
from now on, we are going to assume that x* satisfies the Mangasarian-Fromovitz (MF) constraint qualification. 

Suppose by contradiction that (A* is unbounded. Define, for each k, 

**=lk^it*)IL=»«{ll 4 *L'IHL}- 

Then, 

lim sup M k = zc. 

Refining the sequence and reindexing it, we may suppose that > for all k and 

lim-v M k = + oc. 
Now, define 

Observe that, for all k 

Hence, the sequence is bounded and has a cluster point (-:, ji) satisfying 

> o, lldfilL = 1 

Dividing (20) by , we obtain 

(l/,Vf fe 3[V/C^ k ) +(y k -^ k )] +h r O k ) T ^ + j r (>f ft )V* = 

Taking the limit along the appropriate subsequence, we conclude that 

Together with (21), this contradicts the constraint qualification MF. 
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Now, since in (20), .A" and li" are bounded, extracting a convergent subsequence, we have that 
^ K r and -> u" > 0. 
Remark 2.2 

We showed above that the AGP condition together with the Mangasarian - Fromovitz constraint qualification 
implies the KKT conditions. This is not true if the constraint qualification does not take place. For example, consider the 
problem 

min x, 

s.t. x z = 0. 

The obvious solution of this problem does not satisfy the KKT conditions. On the other hand, it satisfies the AGP 
condition. Observe, for example, that the sequence [1/k] trivially satisfies the AGP property. 

Consider the nonlinear program given by 

min x, 

s.t. x 1 < 0. 

Clearly, xr* satisfies the Fritz-John condition; but for any sequence {x h } that converges to x",d(x h ,jj"\ does not tend 



SUFFICIENCY IN THE CONVEX CASE 

As it is well known, in convex problems, the KKT conditions imply optimality. Here we will show the same 
sufficiency property which is true for the AGP optimality condition. 

Theorem 3.1 

Suppose that, in the nonlinear program (l)-(2),/and §; are convex, 

i = 1,...., p, and h is an affine function. Let y E [ — cc, Q] . Suppose that x" E ft and that {x H } c iR" are such that 
llm. x < = x". k(x K j = for all k = 0, 1, 2, . . and lim d(x = 0. Then x" is a minimizer of (l)-(2). 

Proof 

Let us prove first that 

ftc ftO^yj, for all x* E a" 

Assume that z E ft. If < and ^rf-f K j < 0, by the convexity of we have that 



to zero. 



(22) 



Moreover, if g^z) < and Sife*} > 0, 



> 9i (x k -) + gl(x k -)(z-x k -) 



> gl(x k )(z - x k j. 



(23) 
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Therefore by (22) and (23), zefi implies that z€G(z*y}; so, fl c SlO'Syj. Note that (5) holds since 
h(x K "\ = MY) = and /i is affine . 

Let us define now 

Let z G ft be arbitrary. Since z G fl(jc K , y) and y r: minimizes tf* - \7(jT J - y ' on this set, we have that 

Vf( m x li f(_z-x li ')+ (1/2} II z-* K II : 

> V/fc^Cy*-**} +(1/21 II y K -i" K II \ 
Taking limits on both side of the above inequality and using the fact that II y K - x 11 II 0, we obtain 

Vf(x*f{z-x*~) +(1/2111 z-x" f> 0. 
Since ft is convex, the above inequality holds replacing z with x" + f(z -x") for all 

t g [0,1]; so, 

tYf^fiz-x*} +^(1/2)11 z- jt" II : > 0. 

Thus, 

Vf(x*f{z -x") + (t/2) II z - jr" || : > 0, 
for all l" g [0,1]. Taking limits for t — 0, we obtain that 

Vf^fiz-x 1 "} >(). 
Since z G H is arbitrary, convexity implies that i ,b is minimizer of (l)-(2). 

THE STRONG CONDITION IN AGP 

In the following lemma, we will show the strong AGP condition. 
Lemma 4.1 

For all y G [-», 0], if jt* and £^tt K ,y) 0, then 7} -s 0. 

Proof 

Observe that 

ft(jr,7; c ft 5 Ct, >0, for all x G IR", y G [-=c, 0]. 



Let us call 



- Vf{x k )), 



y 




Since J£ -l \ y * G 0(s k ,y) c ft 5 0t K , yj, we have, by the definition of projections for all t G [0,1], 
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<[] x* - Vftx*) - (jt K + £(y* - x^n f 

< :■ r -~f- - v\- -■ l -: ~f. -r ■ : < Tf-x\- : . 

So, 

0-/2") || w fi - || : + (w K - x*fvf(x*-) 

< (r/2) II y K -.r K II : + tO rK - x*f < 0, 
for all r E [0.1]. 

Taking limits in the above inequalities and using the fact that II w K - x K ->0, we obtain that, for all t E [0,1], 
Hm k ^it 2 /2} I y* - x* | 2 + t(y ft - x^Vftx*) = 0. 
Therefore, for all f e [0,1], 

W^^ftVs) IE y ft - s K ir+ (y^-x^f vftx*) = 0. (24) 
Sincell y K -x* 1 I is bounded, this implies that 

(y k - x* fvf{x^ = 0. 
Therefore, by (24) with : = 1, we obtain that II y K - ^ k [HO, as we wanted to prove. 
Corollary 4.1 

If x B is a local minimizer of (l)-(2) and y E [-», 0], there exists a sequence c IFi" such that lim £ = and 
lim^(i- K ,>0 = 0. 

Moreover, since by Lemma 4.1 d s {x*,y) -j implies that dC**,?'} 0, the following corollary follows in a 
straightforward way from Theorem 2.2. 

Corollary 4.2 

Assume that x* is a feasible point. Let y E [-», 0]. Suppose that there exists a sequence Jt* -* jr" such that 
d s (x*..f \ 0. Then is a Fritz-John point of (l)-(2). 

We will show that the strong AGP property is a sufficient condition for minimizers of convex problems, without 
the requirement k^x* 1 "} = 0. This property is stated in the following theorem. 

Theorem 4.1 

Assume that, in the nonlinear program (l)-(2),/and g t are convex, i = 1, ,p, and h is an affine function. Let 
y E [-sc. 0]. Suppose that x " E Q and {x*} c IR" are such that lim x* 1 = x* and lim d^ftr* y} = 0. Then jr" is a minimizer of 
(l)-(2). 

CONCLUSIONS 

The optimality condition is proved explicitly in inexact restoration algorithms [13-14] and it can be easily 
verified in augmented Lagrangian methods. In other cases [17-18], it could demand some detailed research analysis. The 
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set of AGP points is a sharper approximation to the set of local minimizers than the set of Fritz -John points; perhaps , 
there can be identified other sharp approximations to the minimizers that can be linked to the convergence of good 
minimization algorithms. This will be the subject of future research. Further research is necessary in order to extend the 
new optimality condition to nonsmooth optimization , variational inequality problems, bilevel programming , and vector 
optimization [20-25]. As in the smooth case analyzed in this paper, the guiding line comes from having in mind what 
efficient algorithms do for these problems, what kind of convergence results have already been proved for them, and which 
good and obvious practical behavior has been lost in those results. 
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